Concurrent Q-Learning for Autonomous Mapping and Navigation
نویسندگان
چکیده
This paper presents a new algorithm for goalindependent Q-learning. The model was tested on a simulation of the Morris watermaze task. The new model learns faster than conventional Q-learning and experiences no interference when the goal location is moved. Once the new location is discovered the system is able to navigate directly to the platform on subsequent trials. The model was also tested on watermaze tasks involving barriers. The presence of barriers did not affect the acquisition of “one-trial” learning. While presented as a navigational and mapping technique, the model could be applied to any reinforcement learning task with a variable reward structure.
منابع مشابه
A Q-learning Based Continuous Tuning of Fuzzy Wall Tracking
A simple easy to implement algorithm is proposed to address wall tracking task of an autonomous robot. The robot should navigate in unknown environments, find the nearest wall, and track it solely based on locally sensed data. The proposed method benefits from coupling fuzzy logic and Q-learning to meet requirements of autonomous navigations. Fuzzy if-then rules provide a reliable decision maki...
متن کاملBehavior Based Control and Fuzzy Q-learning for Autonomous Mobile Robot Navigation
This paper presents collaboration of behavior based control and fuzzy Q-learning for mobile robot navigation systems. There are many fuzzy Qlearning algorithms that have been proposed to yield individual behavior like obstacle avoidance, find target and so on. However, for complicated tasks, it is needed to combine all behaviors in one control schema using behavior based control. Based this fac...
متن کاملConcurrent algorithms for autonomous robot navigation in an unexplored terrain
Navigation planning is one of the most vital aspects of an autonomous mobile robot. The problem of navigation in a completely known obstacle terrain is solved in many cases. Comparatively less number of research results are reported in literature about robot navigation in a completely unknown obstacle terrain. In recent times, this problem is solved by imparting the learning capability to the r...
متن کاملUsing Q-Learning and Fuzzy Q-Learning Algorithms for Mobile Robot Navigation in Unknown Environment
One of the standing challenging aspects in mobile robotics is the ability to navigate autonomously. It is a difficult task, which requiring a complete modeling of the environment. This paper presents an intelligent navigation method for an autonomous mobile robot which requires only a scalar signal like a feedback indicating the quality of the applied action. Instead of programming a robot, we ...
متن کاملConcurrent Mapping and Localization for Multiple Autonomous Underwater Vehicles
This paper considers the problem of cooperative mapping and navigation (CMAN) by multiple autonomous underwater vehicles (AUVs). The goal is for several AUVs to concurrently build maps of an unknown environment, and to use these maps for navigation. This work builds on our previous research in development of concurrent mapping and localization (CML) techniques for a single vehicle. In this pape...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003